Method and device for background mitigation

ABSTRACT

An earpiece includes an Ambient Sound Microphone (ASM) configured to measure a background noise signal, an Ear Canal Receiver (ECR) configured to deliver audio to an ear canal, and an optional Ear Canal Microphone (ECM) configured to convert an internal sound within an ear canal of a user to an internal sound signal, and a processor operatively coupled to the ASM, the ECR and optionally the ECM. Note, internal sounds can also include residual background noise related to ambient sounds in the environment. The processor is configured to maintain a natural audio level based on a combined measurement of the background noise signal and the internal sound signal. Other embodiments are disclosed.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation application of U.S. patentapplication Ser. No. 12/165,022 filed Jun. 30, 2008, which is aNon-Provisional application of and claims the priority benefit ofProvisional Application No. 60/946,834 filed on Jun. 28, 2007 (AttorneyDocket No. PRS-136US/PERS-0032-PR), the entire disclosure of which isincorporated herein by reference. This application is also related toU.S. Provisional Application No. 60/885,917 filed on Jan. 22, 2007entitled “Method and Device for Acute Sound Detection and Reproduction”Attorney Docket No. PERS-0015-PR, later converted to a non-provisionalapplication 12/017,878 (Attorney Docket No. PERS-0014-US), the entiredisclosure of both of which are incorporated herein by reference. Thisapplication is also related to U.S. provisional patent application No.60/887,165 filed on Jan. 30, 2007 entitled “Sound Pressure LevelMonitoring and Notification System” Attorney Docket No. PERS-0016-PR,later converted to a non-provisional application PERS-0015-US(application Ser. No. 12/022,826), the entire disclosure of both ofwhich are incorporated herein by reference. This application is alsorelated to U.S. Provisional Application No. 60/883,013 filed on Dec. 31,2006 entitled “Method and Device for Sound Signature Detection” AttorneyDocket No. PERS-0014PR, later converted to a non-provisional applicationwith application Ser. No. 11/966,457 (Attorney Docket No. PERS-0012-US),the entire disclosure of both of which are incorporated herein byreference.

FIELD

The present invention relates to a device that monitors sound directedto an occluded ear, and more particularly, though not exclusively, to anearpiece and method of operating an earpiece that monitors backgroundnoise levels and processes audio.

BACKGROUND

People that use headphones or earpieces generally do so for musicenjoyment or voice communication. The user is generally immersed in theaudio experience when using such devices. These devices deliver acousticsound to the ear.

Background noises in the environment can contend with the acousticsounds produced from these devices. As the background noise levelschange, the user may need to adjust the volume to listen to their musicover the background noise.

A need therefore exists for improving the sound delivery experience ofheadphones or earpieces.

SUMMARY

Embodiments in accordance with the present invention provide a methodand device for background noise mitigation.

In a first embodiment, an earpiece can include an Ambient SoundMicrophone (ASM) configured to measure a background noise level, an EarCanal Receiver (ECR) configured to deliver audio content to an earcanal, and a processor operatively coupled to the ASM and the ECR. Theprocessor can be configured to maintain an approximately constant ratiobetween an audio content level (ACL) of the audio content and a residualbackground noise level within the ear canal based on characteristics ofthe background noise level.

The processor can subtract an attenuation level or noise reductionrating of the earpiece from an ambient sound level of the ambient soundto estimate the residual background noise level within the ear canal.The processor can regulate ambient sound from the ASM to the ECR tomaintain the approximately constant ratio. The sound produced within theear canal upon mitigation of the background noise can be approximatelythe same frequency representation as the ambient sound. The processorcan select a compression based on an amplitude level and a frequencycontent of the residual background noise. The processor can adjust soundlevels in the ear canal to maintain the constant signal-to-noise ratiousing the compression.

The earpiece can further comprise an ear Canal Microphone (ECM)configured to measure directly the residual background noise levelwithin the ear canal. The processor upon detecting sound activity withinthe ear canal via the ECM, can update the residual background noiselevel to compensate for a sound level or the sound activity. The soundactivity can include voice activity or audio content activity such asmusic.

In a second exemplary embodiment, an earpiece can include an AmbientSound Microphone (ASM) configured to measure a background noise signal,an Ear Canal Receiver (ECR) configured to deliver audio to an ear canal,an Ear Canal Microphone (ECM) configured to convert an internal soundwithin an ear canal of a user to an internal sound signal, and aprocessor operatively coupled to the ASM, the ECR and the ECM. Theprocessor can be configured to maintain a natural audio level based on acombined measurement of the background noise signal and the internalsound signal.

In one arrangement, the processor can estimate the residual backgroundnoise signal within the ear canal by subtracting an estimated audiocontent sound level (ACL) from the background noise signal. In anotherarrangement, the processor can estimate the residual background noisesignal within the ear canal by subtracting a noise reduction rating fromthe background noise signal. The earpiece can estimate a sensitivity ofthe ASM and the ECM, and update the residual background noise signalbased on characteristics of the sensitivity.

In a third exemplary embodiment, a method for audio processing suitablefor use with an earpiece can include the steps of delivering audio to anear canal, measuring a residual background noise level within the earcanal, and adjusting the audio based on characteristics of the residualbackground noise level to maintain a natural audio level. The method caninclude monitoring background noise levels external to the ear canal,and estimating the residual background noise level by subtracting anestimated audio content sound level (ACL) from the background noiselevel. The residual background noise level can be measured within theear canal, and the background noise level can be measured external tothe ear canal. A mixing of an ambient sound signal and an ear canalsignal and be calculated, and the residual background noise level can becalculated based on the mixing.

The method can include subtracting an estimated audio content soundlevel (ACL) from the background noise level when an ambient soundmicrophone is used to measure the background noise, and/or subtracting anoise reduction rating from the background noise level when an ear canalmicrophone is used to measure the background noise. The method caninclude determining a sensitivity of an ambient sound microphone and anear canal microphone, and updating the residual background noise levelbased on characteristics of the sensitivity.

As part of the method, an audio level of audio presented to the earcanal can be adjusted to maintain an approximately constant signal tonoise ratio of the audio content level to the residual background noiselevel within the ear canal. A delivery of ambient sound to the ear canalcan be regulated to maintain an approximately constant signal to noiseratio of the audio content level to the residual background noise levelwithin the ear canal.

The method can further include selecting a compression based on anamplitude level and a frequency content of the residual backgroundnoise, and adjusting an audio level of the audio in the ear canal tomaintain a constant signal to noise ratio using the compression. Thecompression can be characterized by a compression curve with a knee thatis a function of the residual background noise. In one arrangement, theknee can correspond to a gate level of the audio content level.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a pictorial diagram of an earpiece in accordance with anexemplary embodiment;

FIG. 2 is a block diagram of the earpiece in accordance with anexemplary embodiment;

FIG. 3 is a flowchart of a method for audio processing based on residualbackground noise signals suitable for use with an earpiece in accordancewith an exemplary embodiment;

FIG. 4 is a flowchart for estimating residual background noise levelsfrom a combination of measurements at an ambient sound microphone and anear-canal microphone in accordance with an exemplary embodiment;

FIG. 5 is a flowchart of a method for background noise mitigation inaccordance with an exemplary embodiment;

FIG. 6 is a flowchart of a method for maintaining constant audio contentlevel (ACL) residual background noise level in accordance with anexemplary embodiment;

FIG. 7 is a flowchart of a method for safe level checking to monitor atotal sound exposure of the listener in accordance with an exemplaryembodiment; and

FIG. 8 is a plot of compression curves in accordance with an exemplaryembodiment.

DETAILED DESCRIPTION

The following description of at least one exemplary embodiment is merelyillustrative in nature and is in no way intended to limit the invention,its application, or uses.

Processes, techniques, apparatus, and materials as known by one ofordinary skill in the relevant art may not be discussed in detail butare intended to be part of the enabling description where appropriate,for example the fabrication and use of transducers. Additionally in atleast one exemplary embodiment the sampling rate of the transducers canbe varied to pick up pulses of sound, for example less than 50milliseconds.

In all of the examples illustrated and discussed herein, any specificvalues, for example the sound pressure level change, should beinterpreted to be illustrative only and non-limiting. Thus, otherexamples of the exemplary embodiments could have different values.

Note that similar reference numerals and letters refer to similar itemsin the following figures, and thus once an item is defined in onefigure, it may not be discussed for following figures.

Note that herein when referring to correcting or preventing an error ordamage (e.g., hearing damage), a reduction of the damage or error and/ora correction of the damage or error are intended.

Broadly stated, exemplary embodiments herein are directed to an earpieceand method for audio processing suitable for use with the earpiece thatcomprises delivering audio to an ear canal, measuring a residualbackground noise level within the ear canal, and adjusting the audiobased on characteristics of the residual background noise level (e.g.,the sound pressure level of the background noise level) to maintain anatural audio level. In one aspect, a natural audio level preserves anoriginal volume to background noise level established by the user asoriginally selected by the user. In another aspect, a natural audiolevel preserves the fidelity and spectral content of the audio asoriginally selected by the user (e.g., graphic equalization) in aparticular environment or context. For instance, as background noiselevels change while a user is listening to music, the residual sounds inthe ear canal change; the earpiece automatically adjusts the volumelevel to a preferred setting to maintain a natural music signal level toresidual background noise level within the ear canal. In one case, thepreferred setting can be automatically set when the user makes the musicselection and adapted thereafter.

At least one exemplary embodiment of the invention is directed to anearpiece for background noise mitigation. Reference is made to FIG. 1 inwhich an earpiece device, generally indicated as earpiece 100, isconstructed in accordance with at least one exemplary embodiment of theinvention. As illustrated, earpiece 100 depicts an electro-acousticalassembly 113 (also referred to herein as assembly 113) for an in-the-ear(in-ear) acoustic assembly, as it would typically be placed in the earcanal 131 of a user 135. The earpiece 100 can be an in the ear earpiece,behind the ear earpiece, receiver in the ear, open-fit device, or anyother suitable earpiece type. The earpiece 100 can be partially or fullyoccluded in the ear canal, and is suitable for use with users havinghealthy or abnormal auditory functioning.

Earpiece 100 includes an Ambient Sound Microphone (ASM) 111 to captureambient sound, an Ear Canal Receiver (ECR) 125 to deliver audio to anear canal 131, and an Ear Canal Microphone (ECM) 123 to capture internalsounds within the ear canal and also assess a sound exposure levelwithin the ear canal. The earpiece 100 can partially or fully occludethe ear canal 131 to provide various degrees of acoustic isolation. Theassembly is designed to be inserted into the user's ear canal 131, andto form an acoustic seal with the walls 129 of the ear canal at alocation 127 between the entrance 117 to the ear canal 131 and thetympanic membrane (or eardrum) 133. Such a seal is typically achieved bymeans of a soft and compliant housing of assembly 113. Such a seal ispertinent to the performance of the system in that it creates a closedcavity of ear canal 131 (also referred to herein as closed cavity 131 orear canal cavity 131) of approximately 5 cc between the in-ear assembly113 and the tympanic membrane 133. As a result of this seal, the ECR(speaker) 125 is able to generate a full range bass response whenreproducing sounds for the user. This seal also serves to significantlyreduce the sound pressure level at the user's eardrum 133 resulting fromthe sound field at the entrance to the ear canal 131. This seal is alsothe basis for the sound isolating performance of the electro-acousticalassembly 113.

Located adjacent to the ECR 125, is the ECM 123, which is acousticallycoupled to the (closed) ear canal cavity 131. One of its functions isthat of measuring the sound pressure level in the ear canal cavity 131as a part of testing the hearing acuity of the user as well asconfirming the integrity of the acoustic seal and the working conditionof itself and the ECR 125. The ECM 123 can also be used for capturingvoice that is resonant within the ear canal when the user is speaking topermit voice communication.

The ASM 111 is housed in an assembly 113 and monitors sound pressure atthe entrance to the occluded or partially occluded ear canal. The ASM111 can also be used to capture the user's voice externally forpermitting voice communication. All transducers shown can receive ortransmit audio signals to a processor 121 that undertakes audio signalprocessing and provides a transceiver for audio or voice via the wiredor wireless communication path 119.

The earpiece 100 can actively monitor a sound pressure level both insideand outside an ear canal and enhance spatial and timbral sound qualitywhile maintaining supervision to ensure safes sound reproduction levels.The earpiece 100 in various exemplary embodiments can conduct listeningtests, filter sounds in the environment, monitor warning sounds in theenvironment, present notification based on identified warning sounds,maintain constant audio content to ambient sound levels, and filtersound in accordance with a Personalized Hearing Level (PHL).

Referring to FIG. 2, a block diagram of the earpiece 100 in accordancewith an exemplary embodiment is shown. As illustrated, the earpiece 100can include a processor 206 operatively coupled to the ASM 111, ECR 125,and ECM 123 via one or more Analog to Digital Converters (ADC) 202 andDigital to Analog Converters (DAC) 203. The processor 206 can measureambient sounds in the environment received at the ASM 111 and internalsounds captured at the ECM 123. Ambient sounds correspond to soundswithin the environment such as the sound of traffic noise, street noise,conversation babble, or any other acoustic sound.

Ambient sounds can also correspond to industrial sounds present in anindustrial setting, such as, factory noise, lifting vehicles,automobiles, and robots. Internal sounds can correspond to soundcontained within the ear canal 131 such as spoken voice or audio contentdelivered by way of the ECR 125. The internal sounds can also includeresidual background noise related to ambient sounds in the environment;for example, high level sounds that leak around the ear seal at location127 and enter the ear canal 131. The processor 206 can monitor theambient sound captured by the ASM 111 for sounds in the environment,such as an abrupt high energy sound corresponding to an on-set of awarning sound (e.g., bell, emergency vehicle, security system, etc.),siren (e.g., police car, ambulance, etc.), voice (e.g., “help”, “stop”,“police”, etc.), or specific noise type (e.g., breaking glass, gunshot,etc.).

The processor 206 can utilize computing technologies such as amicroprocessor, Application Specific Integrated Chip (ASIC), and/ordigital signal processor (DSP) with associated storage memory 208 suchas Flash, ROM, RAM, SRAM, DRAM or other like technologies forcontrolling operations of the earpiece device 100. The memory 208 canstore program instructions for execution on the processor 206 as well ascaptured audio processing data.

The memory 208 can also store program instructions for execution on theprocessor 206 as well as captured audio processing data and filtercoefficient data. The memory 208 can be off-chip and external to theprocessor 206, and include a data buffer to temporarily capture theambient sound and the internal sound, and a storage memory to save fromthe data buffer the recent portion of the history in a compressed formatresponsive to a directive by the processor 206. The data buffer can be acircular buffer that temporarily stores audio sound at a current timepoint to a previous time point. It should also be noted that the databuffer can in one configuration reside on the processor 206 to providehigh speed data access. The storage memory 208 can be non-volatilememory such as SRAM to store captured or compressed audio data.

The earpiece 100 can include an audio interface 212 operatively coupledto the processor 206 to receive audio content, for example from a mediaplayer or cell phone, and deliver the audio content to the processor206. The processor 206 responsive to detecting acute sounds can adjustthe audio content and pass the acute sounds directly to the ear canal.For instance, the processor can lower a volume of the audio contentresponsive to detecting an acute sound for transmitting the acute soundto the ear canal. The processor 206 can also actively monitor the soundexposure level inside the ear canal and adjust the audio to within asafe and subjectively optimized listening level range.

The earpiece 100 can further include a transceiver 204 that can supportsingly or in combination any number of wireless access technologiesincluding without limitation Bluetooth™, Wireless Fidelity (WiFi),Worldwide Interoperability for Microwave Access (WiMAX), and/or othershort or long range communication protocols. The transceiver 204 canalso provide support for dynamic downloading over-the-air to theearpiece 100. It should be noted also that next generation accesstechnologies can also be applied to the present disclosure.

The power supply 210 can utilize common power management technologiessuch as replaceable batteries, supply regulation technologies, andcharging system technologies for supplying energy to the components ofthe earpiece 100 and to facilitate portable applications. A motor (notshown) can be a single supply motor driver coupled to the power supply210 to improve sensory input via haptic vibration. As an example, theprocessor 206 can direct the motor to vibrate responsive to an action,such as a detection of a warning sound or an incoming voice call.

The earpiece 100 can further represent a single operational device or afamily of devices configured in a master-slave arrangement, for example,a mobile device and an earpiece. In the latter exemplary embodiment, thecomponents of the earpiece 100 can be reused in different form factorsfor the master and slave devices.

FIG. 3 is a flowchart of a method 300 for background noise mitigation inaccordance with an exemplary embodiment. The method 300 can be practicedwith more or less than the number of steps shown and is not limited tothe order shown. To describe the method 300, reference will be made tocomponents of FIG. 2, although it is understood that the method 300 canbe implemented in any other manner using other suitable components. Themethod 300 can be implemented in a single earpiece, a pair of earpieces,headphones, or other suitable headset audio delivery devices.

The method 300 can start in a state wherein the earpiece 100 has beeninserted and powered on. As shown in step 302, the earpiece 100 canmonitor the environment for ambient sounds received at the ASM 111.Ambient sounds correspond to sounds within the environment such as thesound of traffic noise, street noise, conversation babble, or any otheracoustic sound. Ambient sounds can also correspond to industrial soundspresent in an industrial setting, such as factory noise, liftingvehicles, automobiles, and robots to name a few.

Although the earpiece 100 when inserted in the ear can partially occludethe ear canal, the earpiece 100 may not completely attenuate the ambientsound. During the monitoring of ambient sounds in the environment, theearpiece 100 also monitors ear canal levels via the ECM 123 as shown instep 304. The passive aspect of the physical earpiece 100, due to themechanical and sealing properties, can provide upwards of a 22-26+dBnoise reduction. However, portions of ambient sounds higher than 26 dBmay still pass through the earpiece 100 into the ear canal generatingresidual sound in the ear canal.

At step 306, a determination of whether sound activity is detected canbe made. Sound activity can correspond to audio content (e.g., music,voice mail, voice), and/or spoken voice (i.e., when the user of theearpiece 100 is speaking). Sound within the ear canal 131 can also beprovided via the audio interface 212. The audio interface 212 canreceive the audio content from at least one among a portable musicplayer, a cell phone, and a portable communication device. The audiointerface 212 responsive to user input can direct sound to the ECR 125.For instance, a user can elect to play music through the earpiece 100which can be audibly presented to the ear canal 131 for listening. Theuser can also elect to receive voice communications (e.g., cell phone,voice mail, messaging) via the earpiece 100. For instance, the user canreceive audio content for voice mail or a phone call directed to the earcanal via the ECR 125.

If at step 306, sound activity (e.g., music, cell phone, spoken voice)is not detected, the earpiece 100 monitors residual background noiselevel in the ear canal at step 308. Residual background noise isresident in the ear canal and can be heard by the user. The residualbackground noise (sound) can be a residue of the background sounds inthe ambient environment that are not completely attenuated by theearpiece 100. For example, a loud explosion, car horn, siren, snoring,or crash sound in the environment may pass through (passively) theearpiece 100 as residual sound and be heard by the user wearing theearpiece. The processor 206 by way of the ECM 123 can monitor the earcanal for residual background noises corresponding to ambient backgroundnoises in the environment.

The processor 206 can distinguish residual background noise from soundactivity such as audio content by way of configuration logic. Forinstance, in the case of detecting audio content, the processor 206 isaware whether it is delivering audio content to the ECR 125. The controllogic establishes whether the processor 206 is actively playing sound(e.g., music), or actively receiving a phone call, for example, fromaudio data and/or information that is provided from the audio interface212. Configuration logic does not include analyzing acoustic sound waveswithin the ear canal to discriminate among differing sound patterns.

The processor 206 can however discriminate between spoken voice (whenthe user is speaking) and residual background noise based oncharacteristics of the user's voice, such as, level, frequency, andduration. For instance, upon detecting periods of up and down energyfluctuations within certain time interval durations and within certainfrequency ranges, the processor 206 can flag a presence of voice-speechis characterized by periods of energy fluctuations over time (e.g. wordsor phrases). The processor 206 can also include voice activity detectionlogic to assess whether internal sounds captured in the ear canal havecharacteristics (e.g., level, pitch, energy, onset, etc) that correspondto spoken voice for detecting sound activity. This permits the processor206 to discriminate between spoken voice and residual background noisesin the ear canal.

If at step 306 sound activity is detected, the earpiece compensates theresidual background noise level in the ear canal at step 310. Forinstance, as discussed ahead, the earpiece can account for an audiocontent level or a noise reduction rating of the earpiece 100. In onecase, the processor 206 can estimate (or update) the residual backgroundnoise signal within the ear canal by subtracting an estimated audiocontent sound level (ACL) from the background noise signal.Alternatively, or in combination, the processor 206 can estimate (orupdate) the residual background noise signal within the ear canal bysubtracting a noise reduction rating from the background noise signal.

At step 312, the earpiece 100 selects a compression based on theresidual background noise level. The compression can be a time domain ora frequency domain transformation that is applied to the audio contentto amplify or attenuate portions of the audio content waveforms. FIG. 8illustrates a first compression curve 810 and a second compression curve820 that are a function of the residual background noise level. Morespecifically, the compression is characterized by a compression curvewith a knee 811 that is a function of the residual background noiselevel (BNL). The knee 811 can correspond to a gate level 812 of theaudio content level.

Returning back to FIG. 3, the earpiece 100 upon selecting a compressionadjusts sound levels in the ear canal to maintain a constant signal tonoise ratio as shown in step 318. The processor 206 can thus, indetermination of the residual background noise measured within the earcanal, mitigate the effects of the background noise by adjusting thevolume level and frequency response of the audio content delivered tothe ear canal. Alternatively, or in combination, the processor 206 canalso regulate the throughput of ambient sound from the ASM 111 to theECM 123 to maintain a constant signal to noise ratio.

The method 300 can continue back to step 302 and 304 to monitor ambientsounds in the environment and residual background noise levels in theear canal, respectively.

FIG. 4 is a flowchart of a method 400 for compensating the residualbackground noise level. The method 400 relates to method step 310 ofFIG. 3 for compensating the residual background noise level based on adetermination of sound activity. The method 400 can be practiced withmore or less than the number of steps shown and is not limited to theorder shown.

Briefly, method 400 receives as input a background noise estimate fromthe ambient sound signal from ASM 111 and/or the internal sound signalfrom the ECM 123. The method 400 updates the residual background noiselevel depending on which microphone (ASM or ECM) is used to measure theresidual noise. This is done to compensate for differences in location,sensitivity, and configuration of the earpiece 100 operating modes andcomponent configurations (e.g., ASM 111, ECM 123, ECR 125).

If at step 418, it is determined that the ECM 123 was used to calculatethe Background Noise Level (BNL), the processor 206 at step 424subtracts off an audio content level (ACL) of the audio content 420 toupdate the residual background noise level measured within the earcanal. (Subtracts refers to removing the contribution, though theoperation may be a multiplication or division operation; sound levelscan be expressed as SPL ratios (division) which in dB is a subtraction.)Recall, that the audio interface 212 can deliver music to the processor206 and that music is played out the ECR 125. The processor 206 at step424 accounts for the level of the audio content when assessing theresidual background noise levels when sound activity is detected byremoving the audio content level (see FIG. 3).

In one arrangement, the processor 206 can apply an ear-canal transferfunction to the audio content delivered to the ECR 125 to obtain anestimate of the audio content level. Moreover, the processor in periodsof non-spoken activity can update the transfer function to improve theestimate of the transfer function. Upon estimating the audio contentlevel, the processor can update the residual background noise levels bysubtracting off the estimated audio content level. In this manner, theECM 123 can be used alone to provide an estimate of the residualbackground noise within the ear canal.

If at step 418 it is however determined that the ASM 111 was used tocalculate the background noise level, the processor 206 at step 426subtracts a noise reduction rating (NRR) 428 from the background noiselevel to estimate the residual background noise level within the earcanal. Recall, the sealing aspect of the earpiece 100 provides a degreeof acoustic isolation expressed as a noise reduction rating (NRR). Inthis manner, the processor can monitor the ASM 111 to provide anestimate of the residual background noise within the ear canal.

As shown in steps 430 and 434, the ASM sensitivity and ECM sensitivitycan be respectively taken into account when calculating the residualbackground noise level. The ASM and ECM sensitivity can be measuredthrough scheduled or random calibration tests administered by theearpiece 100. For instance, to evaluate the ECM sensitivity, theprocessor 206 can direct the ECR 125 to emit a conditioned test tone andsimultaneously listen to the generated test tone via the ECM 123. Theprocessor 206 can compare the frequency response of the captured testtone with a calibrated frequency response to determine any offset insensitivity. When the earpiece is removed from the ear, the processor,upon detection by the earpiece 100 or from manual intervention, candirect the ECR 125 to emit a conditioned test tone and simultaneouslylisten to the generated test tone via the ASM 111. The earpiece 100 isremoved to permit passage of sound from the ECR 125 to the ASM 111 asshown in FIG. 1. Similarly, the processor can compare the frequencyresponse of the captured test tone with a calibrated frequency responseto determine any offset in sensitivity.

The residual background noise resident in the ear canal can also beestimated from a combination of the ASM 111 and ECM 123 measurements.Accordingly, the method 400 can further include determining a mixing ofan ambient sound signal and the internal (e.g. ear canal) signal, andcalculating the residual background noise level based on the mixing.Upon determining the compensation levels, the method 400 can proceed todetermine compression curves (see FIG. 8) based on characteristics ofthe residual background noise level. The compression curves (810 and820) can be implemented by various types of filters (FIR, IIR,parametric, bi-quad, etc.) Upon selecting a compression, the earpiece100 adjusts an audio level of audio presented to the ear canal tomaintain an approximately constant signal to noise ratio of the audiocontent level to the residual background noise level within the earcanal.

FIG. 5 is a flowchart of a method 500 for maintaining constant audiocontent level (ACL) to residual background noise level (BNL). The method500 can be practiced with more or less than the number of steps shownand is not limited to the order shown. To describe the method 500,reference will be made to components of FIG. 2, although it isunderstood that the method 500 can be implemented in any other mannerusing other suitable components. The method 500 can be implemented in asingle earpiece, a pair of earpieces, headphones, or other suitableheadset audio delivery devices.

Briefly, FIG. 5 describes a method 500 for Constant Signal-to-NoiseRatio (CSNRS) based on measured residual background noise within the earcanal. At step 504 an input signal is captured from the ASM 111 andprocessed at step 510 (e.g. ADC, EQ, gain). Similarly, at step 506 aninput signal from the ECM 123 is captured and processed at step 512. Themethod 500 also receives as input an Audio Content signal 502, e.g. amusic audio signal from a portable Media Player or mobile-phone, whichis processed with analog and digital signal processing as shown in step508. An Audio Content Level (ACL) is determined at step 514 thatincorporates at step 516 an earpiece (earphone) sensitivity, and returnsa dBV value.

In at least one exemplary embodiment, method 500 calculates a RMS valueover a window (e.g. the last 100 ms). The RMS value can be firstweighted with a first weighting coefficient and then averaged with aweighted previous level estimate. The ACL is converted to an equivalentSPL value (ACL), which can use either a look-up-table or algorithm tocalculate the ear-canal SPL of the signal if it was reproduced with theECR 125. To calculate the equivalent ear canal SPL, the sensitivity ofthe ear canal receiver can be factored in during processing.

At step 522 the BNL is estimated using inputs from either or both theASM signal at step 504, and/or the ECM signal at step 506. These signalsare selected using the BNL input switch at step 518, which may becontrolled automatically or with a specific user-generated manualoperation at step 526. The earpiece 100 noise reduction rating (NRR) canalso be taken into account at step 524 when estimating the BNL, forexample, by subtracting the dB value of the NRR from the BNL. TheEar-Canal SNR is calculated at step 520 by differencing the ACL fromstep 514 and the BNL from step 522 and the resulting SNR 530 is passedto the method step 532 for AGC coefficient calculation. The AGCcoefficient calculation calculates gains for the Audio Content signaland ASM signal from the Automatic Gain Control steps 528 and 536 (forthe Audio Content and ASM signals, respectively). A user preferred SNRcan also be taken into account when calculating the AGC coefficients asillustrated by step 534. Alternatively a default preferred SNR can beused instead at step 538. After the ASM signal and Audio content signalhave been processed by the AGC's 528 and 536, the two signals are mixedat step 540.

At step 542, a safe-level check determines if the resulting mixed signalis too high in level, if it were reproduced with the ECR 125 as shown inblock 544. The safe-level check can use information regarding the user'slistening history to determine if the user's sound exposure is such thatit may cause temporary or permanent hearing threshold shift. If suchhigh levels are measured, then the safe-level check reduces the signallevel of the mixed signals via a feedback path to step 540. Theresulting audio signal generated after step 542 is then reproduced withthe ECR 125.

FIG. 6 is a flowchart of a method 600 for maintaining constant signal tonoise ratio based on automatic gain control (AGC). The method 600 can bepracticed with more or less than the number of steps shown and is notlimited to the order shown. To describe the method 600, reference willbe made to components of FIG. 2, although it is understood that themethod 600 can be implemented in any other manner using other suitablecomponents. The method 600 can be implemented in a single earpiece, apair of earpieces, headphones, or other suitable headset audio deliverydevices.

Method 600 describes calculation of AGC coefficients. The method 600receives as its inputs an Ear Canal SNR 652 and a target SNR 660 toprovide a SNR mismatch 658. The target SNR is chosen from a pre-definedSNR 654, sorted in computer memory or a manually defined SNR 656. Atstep 658, a difference is calculated between the actual ear-canal SNR(SNR-EC) and the target SNR (B) 664 to produce the mismatch 662. Themismatch level 662 is smoothed over time at step 668, which uses aprevious mismatch (M2) 670 that is weighted using single or multipleweighting coefficients 666, to give a new time-smoothed SNR mismatch674. Depending on the magnitude of this mismatch, various operatingmodes 678 can be invoked, for example, by user operating mode 672 or asdescribed by the AGC decision module 676.

FIG. 7 illustrates an exemplary embodiment of a “safe level checking”system 700 which includes a system 702 to monitor the total soundexposure of the listener (SPL_Dose measurement system). The safe levelchecking system 700 can receive input audio 701 from either the audiointerface 212, ambient sound from the ASM 111, internal sound within theear canal via the ECM 123, or sound produced from the ECR 125 andcaptured by the ECM 123.

The safe level checking system 700 can control the reproduction level ofthe ECR 125 signal when generating the output audio 724 to reduce thechance of permanent hearing damage to the user. The safe level checkingsystem 700 can select compression curves (FIG. 8) (based on BNL 722)and/or automatic gain coefficients (AGC) 718 to adjust the input audio701 to within safe listening output audio 724.

The SPL_Dose measurement system 702 keeps a record of the total soundexposure to the listener (measured or estimated at the eardrum). AnSPL_Dose 704 is calculated, that is a percentage value of the runningpersonal exposure dose (i.e. the dose is not reset every day, butcarries on when the earphones are worn), where 100% corresponds to amaximum daily dose (e.g. according to OSHA recommendations) and a valuegreater than 100% indicates that the user may be at risk of permanenthearing damage.

The SPL_Dose value 704 is communicated to the user with either or bothvisual means 708 (e.g. a read-out of the dose on a display on a mobilecommunications device or Portable Media Player (PMP) screen) or withauditory means 706 (e.g. a voice message indicating the SPL_Dose, or avoice message or non-voice message indicating when the SPL_Dose is aparticular value, e.g. 75% and 100%). In at least one exemplaryembodiment, the SPL_Dose is converted to a time value indicating thetotal remaining time that the user can continue to listen to reproducedaudio content at a given average SPL value (e.g. an SPL_valueapproximately equal to the recent average SPL value generated byreproduced audio content). The user can be informed of this time valueusing either or both visual or/and sound means, as with the SPL_Dose.

In another exemplary embodiment, an operating mode 710 is selectedeither manually using interface means 712 (e.g. via a keypad entry on aPMP or mobile phone) or automatically, for instance with non-userchangeable means depending on regional laws, to invoke a fixed maximumreproduction limit 720. This maximum limit may be a peak or RMS dB SPLvalue, approximating the SPL measured at the eardrum. When the “limitingmode” 716 is selected (i.e. either automatically or manually) then theAGC 718 that processes the input audio 701 (e.g. the mix of audiocontent from a media player and audio from the ASM and/or ECM) isupdated so that the maximum peak or RMS value of audio reproduced withthe ECR is equal to the predetermined maximum limit value. In anotherexemplary embodiment, when the limiting mode is not selected, the uppervalue of the AGC is set 714 by the SPL_Dose system 700, e.g. to allowthe user to listen to audio content at a predetermined level for apredetermined length of time to reduce the likelihood of permanenthearing damage.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all modifications, equivalent structures and functions of therelevant exemplary embodiments. Thus, the description of the inventionis merely exemplary in nature and, thus, variations that do not departfrom the gist of the invention are intended to be within the scope ofthe exemplary embodiments of the present invention. Such variations arenot to be regarded as a departure from the spirit and scope of thepresent invention.

1. An earpiece, comprising: an Ambient Sound Microphone (ASM) configuredto measure a background noise signal of an ambient field; an Ear CanalReceiver (ECR) configured to deliver audio to an ear; and a processoroperatively coupled to the ASM and the ECR, where the processor isconfigured to maintain a natural audio level based on a combinedmeasurement of a background noise signal and an internal sound signal.2. The earpiece of claim 1, further comprising an Ear Canal Microphone(ECM) operatively coupled to the processor and configured to convert aninternal sound within the ear canal to the internal sound signal.
 3. Theearpiece of claim 1, wherein the processor is further configured todetermine a residual background noise level within the ear canal basedon at least one of the background noise level of the ambient sound or ameasured ear canal background noise level within the ear canal using anear canal microphone.
 4. The earpiece of claim 3, wherein the processoris further configured to: determine an ear canal signal to noise ratio(SNR) between the audio content level of the audio and the residualbackground noise level; determine a mismatch between the ear canal SNRand a target SNR; and adjust a gain applied to at least one of the audioor the ambient sound based on the mismatch such that an approximatelyconstant SNR is maintained between the audio content level and theresidual background noise level within the ear canal.
 5. The earpiece ofclaim 1, wherein the Ambient Sound Microphone is within a media playeror cell phone operatively coupled to the processor.
 6. The earpiece ofclaim 1, wherein the Ambient Sound Microphone measures the backgroundnoise signal of the ambient sound at an entrance to an occluded earcanal or to a partially occluded ear canal.
 7. The earpiece of claim 1,wherein the processor maintains the natural audio level based onmaintaining a constant signal to noise ratio which is further based onautomatic gain control.
 8. The earpiece according to claim 1, whereinthe processor estimates a residual background noise signal within theear canal by subtracting an estimated audio content sound level (ACL)from a background noise level of the background noise signal.
 9. Theearpiece according to claim 1, wherein the processor estimates aresidual background noise signal within the ear canal by subtracting anoise reduction rating from the background noise signal.
 10. Theearpiece according to claim 1, wherein the processor estimates asensitivity of the ASM and the ECM; and updates a residual backgroundnoise signal based on characteristics of the sensitivity.
 11. Theearpiece according to claim 1, wherein the internal sound signalcomprises an input audio signal.
 12. A method for audio processing, themethod comprising the steps of: delivering audio to an ear canal usingan ear canal receiver; estimating a residual background noise levelwithin the ear canal using an ambient microphone or an ear canalmicrophone; and adjusting the audio based on characteristics of theresidual background noise level to maintain a natural audio level. 13.The method according to claim 12, further comprising: monitoring abackground noise level external to the ear canal; and estimating anupdated residual background noise level by subtracting an estimatedaudio content sound level (ACL) from the background noise level, whereinthe background noise level is measured external to the ear canal. 14.The method according to claim 12, further comprising: determining amixing of an ambient sound signal and an ear canal signal; andcalculating an updated residual background noise level based on themixing.
 15. The method according to claim 12, further comprising:subtracting an estimated audio content sound level (ACL) from thebackground noise level when the ear canal microphone is used to measurethe background noise.
 16. The method according to claim 14, furthercomprising: determining a first sensitivity of the ambient soundmicrophone and a second sensitivity of the ear canal microphone; andupdating the residual background noise level based on characteristics ofthe first and second sensitivity.
 17. The method according to claim 14,further comprising: adjusting an audio level of audio presented to theear canal to maintain an approximately constant signal to noise ratio ofan audio content level to the residual background noise level within theear canal.
 18. The method according to claim 14, further comprising:regulating a delivery of ambient sound to the ear canal to maintain anapproximately constant signal to noise ratio of an audio content levelto the residual background noise level within the ear canal.
 19. Themethod according to claim 14, further comprising: selecting acompression based on an amplitude level and a frequency content of theresidual background noise; and adjusting an audio level of the audio inthe ear canal to maintain a constant signal to noise ratio using thecompression.
 20. The method according to claim 12, wherein the methodfurther maintains a record of a total sound exposure delivered.
 21. Themethod according to claim 12, wherein the method further maintains arecord of a total sound exposure and presents a predetermined soundpressure level dose value.